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ABSTRACT 



Results of the 1985-86 National Assessment of 



Educational Progress (NAEP) survey of American students' knowledge of 
computers suggest that American schools have a long way to go before 
computers can be said to have made a significant impact. The survey 
covered the 3rd, 7th, and llth grade levels and assessed competence 
in knowledge of computers, computer applications, and computer 
programming. Results indicated a widespread lack of familiarity with 
computer applications and programming as well as an emphasis on 
teaching programming rather than using computers in subject areas 
such as reading and English. Results also showed that roughly 30% of 
students nad access to computers at home, but that socioeconomic 
factors played a disturbi j role in limiting mminority students' 
access to computers. Despite the overall poor results, the rumored 
stall in the "computer revolution" disappears upon close examination. 
The NAEP results are 2 years old, based on generally unreliable 
self-report information, derived from a multiple choice test in a 
field which is primarily "hands on." The report's general conclusions 
are also heavily weighted by the computer programming section, but 
general computer literacy is unrelated to knowledge of computer 
programming. The computer revolution may be a growing surge rather 
than an explosion. (RS) 
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A 1989 UPDATE: 
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BEST COPY AVAIUBLE 




In A Nation At StlsK , tne Manorial Coinmissior. on hVce Hence 
in Education suggested that schools add a fourth basic ski!! to 
the three R-s: Conipetsnce m use of computers. The liational 
Assessment of Educational Progress (HASP? nas ^us: puoiisned its 
findings from the i-85-i<?86 survey of Afriericar: sr.aents 
knowledge of computers. 

One of the report s autnors. X'icnae; E. Mar::ne:, presented 
a sumr^ary of the finclngs to Internationa; Sesc.ng Association 
memoers at the .=^88 IRA Convention, in a preconvention institute 
sponsored Dy HicroSIG and aireoted Dy David h-ein'-;inQ and Shelley 
Wepner, Comprenensive results are c^vailaDie m Computer 
Competence: The First Mational Assessment oy Martinez and Mancy 
A. Mead (S14,00, including shipping costs, avaiiatle from NAEP, 
Rosedale Road, Princeton, MJ 08541, 800-223-026?). A discussion 
of the theoretical and practical underpinnings of the Assessment 
is also avai la&le (A Framework for Assessing Computer Competence: 
Defining Objectives , 1986). 

The results suggest that Ajnerican schools have a long way to 
go before we can say that computers have made a significant 
impact. 

The Assessment of Computer Competence followed the same 
basic structure as other NAEP assessments. A national sample was 
Obtained at tnree grade levels: Third, seventn, and eleventh. 
The test was multiple choice. Competence was assersed in three 
O areas: 



1. Knowledge of Computers—'' the recognition or recall of 
specific Ideas, facts, and procedures related to the use of 
computers" cp. lO). In one set of questions, for example, a 
picture of tne components of a typical microcomputer workstation 
was displayed, and stucents v;ere asKed questions such as, *Whioh 
picture snows a ^oyst-av:?" (answered correctly oy 89% of Src 
graders, ^8% of "^th gracers, and -9% of lith grsders) and "Which 
picture shows a printer?" (81%, 96%, and 98%, respectively). 
Other questions incl^aea, "What Is the mam ro;e of a i^OEPuter 
program?*' cTo ts:! the computer vnat to do, 32%. 34%, 46%) anc 
"What IS an algorithm?" Ci6%-7th grade. 3i%-iith grade;. Overai: 
scores on ite.m3 given to a!l three groups were: 3rd grade, 39%; 
7th grade, 55%: lith graae, 

2. Computer appi Icat Ions— "students skill In using 
applications software, such as word processing, graphics 
programs, dataoase manag.e.ment systems, and spreadsheets" (p. 14). 
!n one set of questions, for example, students v;ere given a 
sample database Including NAME OF STATE, STATE BIRD, STATE 
FLOWER, DATE ST.ATE BECAME P.^^RT OF THE UNITED STATES. They were 
asked, ''Can the class use the database to list all states that 
have red flowers?" cansv;ered correctly by 42% of 3rd graders), 
and 'Can the class use the database to list al! states that have 
the daisy as their state flower?" v58%). A page from a 
spreadsneet was displayed, and students were asked about 
necessary operations to solve simple problems. Overall scores on 
Items given to al! three groups <^ indicates score from a version 
administered only to that particular grade leve!) were: 



Word Processing Graphics DataDases Spreaasheets 

3fCl 31% 38 40 * Not tested 

7th 55% 39 44 * 44 

iltn 72 40 53 ^ 31 * 

3. Computer Progranming. "Third and seventh gracers were 
asked questions aoout Logo and BASIC, the i^ngitages vith uhlcn 
they are most like'.i' to be f.amiliaf. Eleventh graders were a-sked 
questions about BASIC anc Pascal, the most common programming 
:5ng;;ages for high school students' (p, 21?. Scores for 
questions administered to eich specific grace were: 3rd grade 
logo, 2?%t Sra grade BASIC 21%; ~th grade Logo, 28%; "th grade 
BASIC, 26%; lith grade BASIC, 27%; iith grade Pascal, 30%. 

Computer Use in Subject Areas 

Despite the stir created by the ippearance of microcomputers 
in classrooms, computers are little used in subject areas such as 
reading, science, and mathematics The great majority of school 
compui-er use is directed toward teaching of programming. This 
was a surprising finding in the light of today s almost un'versa! 
disdain for spending school time teaching children to program. 

25 percent of third graders surveyed, and only 17 percent of 
eleventh graders, indicated that they had ever jsed a computer in 
reading or English class, 7 percent of seventh graders 'i.ised a 
computer several times a week for reading instruction. 
Interestingly, computer-based mathematics mstrvCtion fared only 
a little better on this measure <10 percent) and science 



Instruction did worse (5 percent). 
Some specific results: 

"Have you ever used a computer in Readlng/EnQl ish?^' Yes- 
Grade 3, 25%: Grade 7, 24%; Grade 11, i?%, 

"How often do you use a computer to practioe Reading?^' 



Grace 7 Grade 11 

Almost every day 3.1^ 1,8% 

Several times a week 3.8 2.1 
ADout once a wee>; 5.'- 2,0 

Less than once a wee'< 3.8 6.9 
Never 78.4 6" ,2 



Home Use of Computers 



Results underscored the potential for schools to use 
computers to build educational partnerships with homes. Roughly 
30 percent of students have access to a computer at home. 
Families in the Northeast scorea quite a Dlt higher on this 
measure, 41% of Northeastern children Indicated that they have a 
computer at home* Results shov;ed that those who cUd have 
computers at home scored higher in computer competence than those 
who did not. We educators sometimes forget how powerful learning 
outside school can be when students are sufficiently motivated. 
Interest in computers has reminded us of tne cruoial importance 
of encouraging informal learning activities !n stuaents- "real" 
1 ives. 
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Access tc Computers 



Socioeconomic factors play a disturbing role in limiting 
minority student access to computers. More White than Black or 
Hispanic students have used a computer. More White students are 
studying with computers. Mere White students have computers at 
home. The differences between ethnic groups are especially 
evident at the lower grade levels assessed by MAEP, the third and 
seventh grades. 

Computer Appl i cat ions 

Among knowledgeable computer-using teachers, there is an 
increasing awareness that drili and practice software is far less 
powerful an educational tool than the major "computer as a tool" 
applications: Word processing, database management, and 
spreadsheets, A major component of the NAEP tested student 
knowledge of these applications. To test knowledge of word 
processing, for example, a passage of text was shown and 
questions were posed, such as, •*Pi_e is spelled wrong four times. 
What is the best way to fix this problem?" (Correct answer: 
Search and Replace). 

Results showed widespread lack of familiarity with the 
applications, though knowledge level increased in the upper 
grades. Word processing proved the exception to these 
disappointing results. Yet simple knowledge of word processing 
did not mean that students benefited from that knowledge. More 
than 75 percent of the seventh and eleventh graders indicated 



that they used a word processor less than once a week or not at 
all tor writing. Only 3 percent of the seventh graders and 4 
percent of eleventh graders used a word processor almost every 
day* 

Crl tique 

The study has great value in providing a baseline of 
information about computer use in the schools and student 
achievement. Several limiting factors must be held in mind, 
however. 

1, The study was carried out in 1985-1986, ana is only now 
being reported. The data are two years out-of-date in an 
educational area that experiences tremendous change, 

2, Much of the data is self-report information from 
students rather than observational. This is notoriously 
unrel iable, 

3, Competence in computers is a "hands-on" Issue, 
Assessing it through paper and pencil multiple choice testing is 
problematic, 

4, General conclusions about student achievement cited in 
the report are often heavily weighted by the Computer Programming 
section. General computer literacy is unrelated to knowledge of 
programming. 
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Conclusions 



The overall poor results might lead some toward pessimism 
about the future role computers will play in classrooms. 
Certainly we have sufficient evidence that the impact of computer 
technology has been minima! thus far, especially in instructional 
applications such as reading and writing. 

Yet, the rumored stall in the "computer revolution" in the 
schools keeps disappearing whenever examined closely. A recent 
study, for example, reported that the number of computers in 
United States K-12 schools increased to 2 million in :^86-i^8". 
Tnis represented an increase of 25 percent over the previous 
school year. .Among other findings (Talmis Group, as reported in 
Goodspeed, Jonathan. 1988, "Two Million Microcomputers Now Used 
in U.S. Schools." Electronic Learning , 7, no. 8 (Hay/June): 
16.): 

Public schools planned to spend an average of $1400 each 
for software during 1987-1988. 

* Public schools spent $170 million for software in 1986-7, 
and this was expected to Increase to $200 million in 1987-8. 

* Schools. own an average of 55 software titles per 
bui Iding, 

The "computer revolution" .niay be more of a growing surge 
than an explosion, but computers are ever more present In the 
schools just as they are in the home and on the job. 
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